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We introduce a model of uncoupled pendula, which mimics the dynamical behavior 
of the Hamiltonian Mean Field (HMF) model. This model has become a paradigm 
for long-range interactions, like Coulomb or dipolar forces. As in the HMF model, 
this simplified integrable model is found to obey the Vlasov equation and to exhibit 
Quasi Stationary States (QSS), which arise after a "collisionless" relaxation process. 
Both the magnetization and the single particle distribution function in these QSS 
can be predicted using Lynden-Bell's theory. The existence of an extra conserved 
quantity for this model, the energy distribution function, allows us to understand 
the origin of some discrepancies of the theory with numerical experiments. It also 
suggests us an improvement of Lynden-Bell's theory, which we fully implement for 
the zero field case. 
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1. Introduction 

The long-range character of the interaction is responsible for unusual properties in 
the thermodynamic and dynamical behaviour in a number of physical situations 
(Dauxois et al. 2002, Campa et al. 2008, Campa et al. 2009, Dauxois et al. 2009). 
Systems falling in this class are self-gravitating systems, two-dimensional hydrody- 
namics, dipolar interacting systems, unscreened plasmas, etc.. 

We will concentrate in this paper on the study of kinetic equations, which allow 
one to extrapolate from the single particle to the collective behavior of a physical 
systems. 

Such equations appear also in the study of quantum transport in miniaturised 
semiconductor devices and nanoscale objects. Indeed, a basic model in this field is 
provided by the Wigner-Poisson equation (Manfredi, 2001), which recasts quantum 
dynamics in the classical phase space. The mathematical structure of the Wigner- 
Poisson system is analogous to that of the Vlasov equation, whose study will be 
the main topic of this paper. 

Two approaches exist for the derivation of kinetic equations, which describe the 
time evolution of the single particle reduced distribution function f{r,\',t). One 
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can begin with the Liouvihe equation for the fuh phase space distribution function 
(Balescu, 1997). Going through the BBGKY hierarchy and using a perturbative ex- 
pansion, one can derive the Vlasov, Landau and Lcnard-Balcscu equations when the 
perturbative parameter is the strength of the potential. Alternatively, one obtains 
the Boltzmann equation if one uses density as a perturbation parameter. 

A second, more straightforward, approach begins instead with the singular em- 
pirical measure in the 6-dimensional single particle phase space and allows one to 
derive the Vlasov and Lenard-Balescu equations using as perturbation parameter 
N being the number of particles (Nicholson, 1992). Rigorous mathematical 
approaches, which began with (Braun et al. 1977, Neunzert 1984), are based on 
this second approach. 

This second approach also emphasizes the role of the mean-field potential, which 
is crucial when the interaction is long-range. In the N ^ oo limit, the Vlasov 
equation becomes exact and the evolution towards Boltzmann-Gibbs equilibrium is 
hindered: the entropy is constant in time. Evolution towards equilibrium appears 
only if one considers 1/A^ corrections, which leads to "true" kinetic equations, see 
(Chavanis, 2008) for a review. 

Nevertheless, already the Vlasov mean-field term induces an evolution of the 
single particle distribution function. It was originally observed by (Henon, 1964) 
that this evolution produces a sort of relaxation and that it preserves some memory 
of the initial state. Following this remark, (Lynden-Bell, 1967) proposed the concept 
of "coUisionless" or "violent" relaxation, which leads the system towards a Vlasov 
"equilibrium" . This relaxation occurs in a time of order 0{N^), whereas later steps 
of relaxation of the finite N system depend on N. 

A model which has recently served as a test ground of these theories is the 
Hamiltonian Mean Field (HMF) model (Antoni & RufTo, 1995), which describes 
a system of rotators with all-to-all coupling. The model has been originally intro- 
duced with the aim of describing collective phenomena in wave-particle systems of 
relevance for plasma physics (Elskens & Escande, 2002). Among the applications of 
interest for this issue, let us quote the one to magnetic layered structures (Campa 
et al. 2007, Dauxois et al. 2010). 

For the HMF model the single particle reduced distribution function f{6,p,t) 
depends on an angle and on the angular momentum. The Vlasov eqiiation is exact 
for this model in the N oo limit, as was early realized by (Messer & Spohn, 
1982). Moreover, the 1/A'' correction to the Vlasov equation, the Lenard-Balescu 
term, vanishes for one-dimensional models like the HMF model (Bouchet 2004, 
Bouchet & Dauxois, 2005). This implies that one can expect the system to evolve 
to equilibrium on time scales larger than 0{N). Indeed, it has been found that the 
system evolves towards Quasi Stationary States (QSS) (Yamaguchi et al. , 2004), 
which can be interpreted as stable stationary solutions of the Vlasov equation and 
whose lifetime increases as N^''^ for homogeneous states. Since the lifetime of QSS 
diverges with iV, we expect that a QSS will last forever in the thermodynamic limit. 

QSS have been interpreted as being states that maximize Lynden-Bell entropy 
(Lynden-Bell, 1967). Quite interestingly, it has been found theoretically, and verified 
numerically, that, depending on the features of the initial state, one can relax to 
either homogeneous or inhomogeneous QSS and that this different evolution can be 
interpreted as a phase-transition (Chavanis 2006, Antoniazzi et al. 2007a, 6). 

Lynden-Bell's approach has been recently successfully applied to the free-electron 
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laser (Barre et al. 2004, Curbis et al. 2007, de Buyl et al. 2009), to the one- 
dimensional self-gravitating sheet model (Yamaguchi 2008, Levin et al. 20086) to 
two-dimensional self-gravitating systems (Teles et al. , 2010) and to models of non- 
neutral plasmas (Levin et al. 2008a). 

The theory however predicts only regimes in which all macroscopic quantities 
are exactly constant in time (stationary regimes) and in which the distribution 
function is a function of the energy alone. This limitation, originating from the 
very same statistical nature of the theory, causes failures whenever oscillations, 
non-monotonous energy distribution or clustering regimes are present. 

Several attempts have been made to give more firm grounds to Lynden-Bell the- 
ory through a careful analysis of the self-consistent interaction present in the Vlasov 
equation and of the complex relaxation phenomenon it is responsible for. Mostly, 
the analysis has been performed in the context of ID self-gravitating systems (Sev- 
erne & Luwel 1986, Funato et al. 1992, Yamashiro et al. 1992, Tsuchiya et al. 1994). 
More recently, a description of Vlasov equilibria in a constant mean-field potential 
has been also introduced (Pomeau, 2008). 

We study in this paper the Vlasov equation for a set of uncoupled pendula 
and we extend Lynden-Bell's theory to this situation. The model we study should 
mimic the behavior of the HMF model when this latter has reached a steady state. 
Since there is no coupling among the pendula, the Vlasov self-consistent potential 
reduces to a constant potential and collisionless relaxation takes place in the absence 
of variations of the potential. 

In spite of all these simplifications, many of the effects found in the HMF model 
are still present and are still well reproduced by the theory. In particular, the theory 
predicts the value of the magnetization attained by the system in the QSS and the 
occurrence of a phase transition from a homogeneous (zero magnetization) QSS 
to an inhomogeneous (magnetized) one. For our simple integrable system, it's also 
easy to understand how to improve the theory by adding conservation laws. We 
here propose to add conservation of moments of the velocity distribution in the 
case of homogeneous states. 

The paper is organized as follows. In Section [2] we introduce the Vlasov equa- 
tion for the system of uncoupled pendula. In Section [3] we present some numerical 
simulations showing the presence of homogeneous and inhomogeneous states. The 
following Section 0] is devoted to the development of Lynden-Bell's theory, which 
is then successfully compared with numerical experiments in Section [5] Section [5] 
discusses some possible improvements of the theory, which includes an extra con- 
servation law and Section [7] presents some conclusions. 



2. Uncoupled pendula and HMF model 

We consider the following Hamiltonian, describing a system of N uncoupled pen- 
dula, 

N 2 N 

H = Y,^~nJ2cos0, , (2.1) 

where 9j is the angle of the j-th pendulum and pj the corresponding angular mo- 
mentum. The external field H represents the action of gravity. 
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Model (12.11) is intended to mimic, in the large N limit, the dynamics of the HMF 
model (Antoni & Ruffo, 1995), whose Hamiltonian is 



N ^2 1 ^ 

Hhmf 



N 2 1 ^ 

Et-^E^o«(^^-^.)- (2-2) 



2 2N 



The rationale for this comparison is that, if one introduces the magnetization 
1 ^ 

m = — (cos 6*^ , sin 0j) = (toj;, rrij^) = m (cos 0, sin 0) , (2-3) 

one can rewrite the potential of the HMF model as — iVm^/2, while the one of 
model (|2.ip reads —NHrrix- It is then evident that the two potentials have the 
same form if one identifies H with nix/ '2 and one disregards the motion of the 
phase of the magnetization, i.e. one sets (j) = Q (m = mx), which can always be 
done without loss of generality taking the rotational invariance of Hamiltonian (j2.2p 
into account. From now on, we will then identify the magnetization m with nix- The 
value of m detects the "homogeneity" of the system: m — Q implies that the system 
is homogeneous while m > indicates an inhomogeneous system. This terminology 
corresponds to a particle representation of both system (12. ip and (|2.2I) , according 
to which, to each pendulum we associate a particle moving on a circle. Then, m = 1 
means that all particles are located at = 0, and therefore the particles are fully 
clustered, while when m — Q the particles are homogeneously dispersed on the 
circle. In the following, we will make use of m to quantify the state of the system 
and track its evolution in time. 

We will not present in this paper results for the finite N case. We will in- 
stead consider the time evolution of the single particle reduced distribution function 
f{9,p,t), which obeys the Vlasov equation 

§f + {/,M-0, (2.4) 

where {■,•} are Poisson brackets and h is the single particle Hamiltonian, which, 
for model (|2.ip is given by 

2 

h{9,p)^?--ncose , (2.5) 
while for the HMF model is 

h-HMF {6,p) = — - rux [/] cos e -my [/] sin 9, (2.6) 

where 

mx[f] = j d9dp cos 9 f (9, p,t) (2.7) 

my[f] = J d9dp sin 9 f {9, p,t) . (2.8) 
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The main difference between the two single particle Hamiltonians is that the one 
of model (I2.ip does not depend on /, it is simply a function of the phase space 
variables. The relation between the two models is here even more evident, it amounts 
to identify mx[f] with "H and to put my[f] = (the factor 1/2 present in the 
previous identification was due to the presence of pair interactions in the potential) . 
The absence of any dependence on / in the single particle Hamiltonian makes a 
big difference. Physically, it means that each particle moves on a constant energy 
trajectory in an external potential which is fixed. This does not mean that / does not 
evolve in time, and therefore we expect also in this case a "collisionless" relaxation. 
The questions we explore in this paper are how well Lynden-Bell's theory represents 
this relaxation and how close it is to the one of the HMF model. A crucial aspect of 
the relaxation of the uncoupled pendula model is the conservation of the following 
energy distribution 



which remains constant in time, as fixed by the initial value of /. Lynden-Bell's 
theory does not take this extra conservation law into account: we will try in Section[B] 
to implement in the theory this aspect for homogeneous states. 

3. Numerical results: homogeneous vs. inhomogeneous states 

We have solved the Vlasov equation (j2.4p for the uncoupled pendula via a semi- 
Lagrangian method coupled to cubic splines. This method is based on a representa- 
tion of / on a grid, i.e. fi,j = f{9i,pj) at the grid points {{6i,pj); i S [1 : Ng];j e [1 : 
Np]}. We refer the reader to (Sonnendriicker et al. 1999) for the semi-Lagrangian 
method, or (de Buyl, 2010) for details regarding mean-field models. The relevant pa- 
rameters for these simulations are: Ng, the number of grid points in the ^-direction, 
Np the number of grid points in the p-direction. At, the time-step and Pmax, which 
defines the size of the simulation box in phase space as [— tt : tt] x [—pmax ■ Pmax] - We 
use in all simulations reported in this paper the following values: Ng = Np — 256, 
Pmax = -Pmin = 2.5 and At = 0.1. 

We consider a "waterbag" initial condition: the particles, or phase space fiuid 
elements, occupy a rectangular region of phase space characterized by a half width 
A9 in angle and Ap in momentum 



Using this initial condition, magnetization at time zero and energy per particle are 
given by mo — and U — limiy^ooH/N = ^ — Hnio, respectively. While the 

magnetization evolves in time, the energy is a conserved quantity. Since the Vlasov 
equation is a Liouville equation for /, the evolution of the waterbag initial condition 
is such that the region occupied by the "fiuid level" /o deforms but conserves its 
area in phase space. Two qualitatively different regimes take place depending on 
whether H is equal to or not. We represent the evolution of the waterbag initial 
condition by the Vlasov dynamics in Fig. [TJ plotting the contour line of the region 




(2.9) 




= /o if \e\ < AO and \p\ < Ap 
= , else. 




(3.1) 
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occupied by the level /o in phase space at different times. The time evolution of m 
is shown in Fig. [21 
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Figure 1. Evolution of the waterbag initial condition with A9 — 1.66 and Ap — 0.57. 
We plot the contour lines of the region occupied by the "fluid level" /o in phase space 
with time increasing from top to bottom. The left column represents the case H — and 
in the right column H = 0.75. 




Figure 2. Magnetization m vs. time for the same conditions of Fig. [T] 
In the free-streaming case ("H = 0) , the magnetization m relaxes asymptotically 
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to zero. Correspondingly, the initial waterbag spreads over the whole [— tt : tt] 
interval. In the H ^ case, a finite value of m is attained at long times, with the 
fluid forming a clump around 9 = 0. This reflects the different evolutions towards 
either a homogeneous state with to = or towards an inhomogeneous state with 



4. Lynden-Bell's theory 

Lynden-Bell's theory (Lynden-Bell, 1967) aims at predicting asymptotic states of 
the Vlasov dynamics. The theory allows one to compute analytically f{0,p), the 
coarse grained single particle distribution function. Lynden-Bell's entropy is derived 
by a combinatorial counting of the allowed states in a phase space cell. We write 
here the expression of the entropy as applicable to the waterbag initial condition 
in formula (13.11) 



s{f) ^-Jdpde 



l\nl+(l-l] Infl-i 
fo /o V foj V fo 



(4.1) 



Under the constraints of "mass" , J fdOdp^ and energy conservation, the maximiza- 
tion of entropy (|4.ip for the waterbag initial condition p.ip leads to the following 
steady state distribution 

f(^'P^ ^ g/3(p2/2-'Hcose)+^ ^ I ' (^^-^^ 

where fi and /3 are Lagrange multipliers associated respectively to mass and energy 
conservation. They can be obtained, together with rngss, the magnetization in the 
QSS, by solving the following set of equations 

^ [d9 e^«^°^«Fo(a;e^«™^'^) - 1 
V J 

^^"^ J dO e^^''°^'F2{xe^'^^°^') ~ Htoqss = U 

j de cos 9 e''"'=°"''Fo(a;e''^'=°"'') = rngss (4.3) 



2/32/3 
VP 



where x = e ^ and the F„ are defined as 



We have solved the system of equations (14. 3p using the Newton-Raphson method 
(Press et al. , 1996). 

In the context of the uncoupled pendula model we are thus free to choose three 
parameters: A9, Ap and H. If we want to compare the behavior of this model 
with the HMF model, we have to reduce the free parameters to two. A physically 
reasonable restriction is to impose the self-consistency condition 

ruQss = H . (4.5) 

Then, once A9 and Ap are given, system (14.31) allows to solve for rngss, P and /i 
(taking into account that U can be written in terms of A9, Ap and toqss), which 
substituted in turn into (j4.2p (with "H = rngss) allows us to obtain the single 
particle distribution function in the QSS. 
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5. Comparing with simulations 

The predicted value of rngss offers a straightforward way to compare the result of 
Lynden-Bell's theory with simulations. In Fig. [3] we plot mqss vs. Ap for A9 = 1.66 
for both theory and numerical experiment. The agreement in all the explored range 
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0.2 
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— LB 
• • simul. 



0.2 0.4 0.6 0.8 1.0 1.2 1.4 1.6 



Ap 



Figure 3. Comparison of the magnetization in the QSS, mgss, as predicted by Lynden- 
Bell's theory with the one resulting from the simulations, for a waterbag initial condition 
(|3.ip characterized by A6' = 1.66. 



of Ap is quite satisfactory. 

A comment is however in order: if the self-consistent criterion is fulfilled with 
H = mqss — 0, mgss converges exactly to in the simulations. This comes 
from the fact that the force term —dh{6,p)/d9 in the Vlasov equation vanishes 
and then the initial waterbag evolves under free streaming, leading necessarily to a 
homogeneous distribution with respect to 9 (see the left column of Fi^T|). The fact 
that we find an agreement also in the region where 'H is less trivial. 

In order to explore with a finer detail the agreement of theory with numeri- 
cal experiments, we proceed to the comparison of the single particle distribution 
function in the QSS. To this aim, we define the marginal distributions 

fip) =Jd9 }{9,p) ■ p{9) ^ j dp }{9,p) . (5.1) 

In Fig. 21 we display the marginal <y3(p) for A9 — 1.66 and for various values of Ap 
and in Fig. [5] the marginal p{9) for the same values of A9 and Ap. 

Apart from a disagreement at small scales, which is expected due to the fila- 
mentary structure of / shown in Fig. [T] (Lynden-Bell's theory provides a prediction 
for the coarse-grained distribution /), the comparison in panels (a), (&) and (c) of 
Figs, m and [S] is quite good. Lynden-Bell's theory catches some basic aspects of the 
spreading of the distribution along constant energy levels induced by the Vlasov 
equation. However, a major drawback of the theory appears in panel (d): while 
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Figure 4. The marginal ip{p) for AO = 1.66 and Ap = 0.41(a),0.72(6), 1.03(c) and 1.34(d). 







— LB 
■■■■ sim. 










-3-2-1 12 3 

e 



Figure 5. The marginal p{9) for the same values of and Ap as in Fig. |4] 



the marginal p{0) is correctly predicted, ip{p) disagrees with numerical simulations. 
This negative result is nevertheless somewhat expected, because the time evolution 
with "H = is a free streaming: each momentum level is conserved by the dynamics. 
This latter aspect is not at all taken into account by the theory, which therefore 
fails to reproduce ip{p)- 

We have checked the predictions of the theory for a specific value of A9: we 
cannot expect them to be reliable for all values of AO. Indeed, the predictions of 
niQss shown in Fig. IH] for A9 = tt are worse, although the transition value of Ap is 
well reproduced. 

Since the source of disagreement, as we have observed above, can be in the 
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Figure 6. Comparison of the magnetization rngss as predicted by Lynden-Bell's theory 
with the one resulting from the simulations. We take here A9 — n. 

failure of the theory to take into account extra conservation laws, we compare in 
Fig. [3 the energy distribution (|2.9p predicted by the theory with the one resulting 
from the numerics (this latter being constant in time and fully determined by the 
initial condition). As expected, when the value of mqss is better predicted (e.g. for 
A9 = TT and Ap = 0.72), the energy distribution found using Lynden-Bell's theory 
is closer to the initial one. 




Figure 7. Energy distributions p{e) given by formula 1)2. 9p for A9 = n, Ap = 0.41 (top 
panel) and — tt, Ap = 0.72 (bottom panel), computed using Lynden-Bell's theory and 
numerically. 



We therefore argue that the success of Lynden-Bell's theory in the case of un- 
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coupled pendula originates partly from the fact that the initial energy distribution 
p(e) is close enough to the one predicted by Lynden-Bell's theory itself. This may 
look accidental and throw some doubts on the general validity of the theory. How- 
ever, the excellent agreement found for AO = 1.66 remains a good indication of the 
quality of the predictions of the theory. Further systematic work of comparison of 
the theory with numerical experiment is required in order to assess the origin of 
disagreements. 



6. Adding conserved quantities in the zero field case 

The failure of Lynden-Bell's theory to reproduce ip{p) for the homogeneous case 
{V. = 0) could be easily understood because of the trivial dynamics involved. A 
deeper remark is that the conservation of the energy distribution p(e) reduces for 
H = to the conservation of (p{p). We here then impose this constraint by requiring 
the conservation of the even moments of 

P2n[f]^ J de dp f{0,p)p'" n=l,2,..., (6.1) 

which is a consequence of the conservation of each individual momentum for the 
uncoupled pendula with H = 0. The odd moments are all zero for symmetry reasons. 
The n — moment is the total "mass" and its conservation is already imposed in 
the Lynden-Bell's theory. The n — 1 moment is the energy and has already been 
considered: we denote the corresponding theory by LBl. We restrict here to impose 
the extra conservation of the n = 2 and n = 3 moments: the corresponding theories 
will be denoted as LB2 and LBS. 

Maximizing Lynden-Bell's entropy (j4.1l) leads to the following coarse grained 
distribution function 

where (3 is the Lagrange multiplier conjugated to the energy, CT2 and (73 those 
corresponding to the n = 2 and rt = 3 moments. The new system of equations to 
be solved is 

/o X 2n Go{x, 13, 0-2,3) = 1 (6.3a) 
foXTTG2{x,l3,a2^3)^U (6.3b) 
/o X 27r G'2„(a;,^, 0-2,3) = -P2n[/|t=o] n = 2, 3 (6.3c) 

where G2„(x, /3, (74,6) = J dv y^-'.^^^fiv'' ji+a^v'+a^v^ ^yi _ 

We find the result displayed in Fig. |S1 The presence of two humps in (^(p) for the 
LB2 theory and three humps for LBS looks surprising, but it should be interpreted 
as similar to the Gibbs phenomenon: approximating a function with a limited set 
of basis functions can give rise to oscillations. Increasing the number of conserved 
moments of ^(ji) can only lead to the waterbag distribution, since it is the only one 
that has the good values of P-2n\f\ for all n's. 

It is worth remarking that, for high values of /?, the LBl theory is able to repro- 
duce a step profile accurately enough, providing good results for the homogeneous 
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Figure 8. Comparison (p{p) obtained from LBl, LB2 and LBS theories (see text) with the 
simulation for Ap — 1.4 and A9 = 1.66. For the LBS theory the values of the Lagrange 
multipliers are; x = 1.29, P = S.98, cr2 = -14.45 and as = 12. SO. 

situations considered here (one can compare this limit with the low temperature 
Fermi distribution). Our extension to the LB2 and LBS theories allows us to obtain 
a better match in all situations where (3 is smaller, as illustrated in Fig. [S] Indeed, 
lower values of A9 (at constant Ap) favour smaller values of /3. On the other hand, 
one can prove, by a direct inspection of Eas l6.3l that, at fixed Ad, /3 scales as Ap~^ 
and cr„ as Ap"^". 

Let us mention that, although computationally more complex, one could in 
principle obtain improved theories in the % ^ Q case by imposing the conservation 
of the moments of the energy distribution p{e). For the HMF model this approach 
is unfortunately not viable because p{e) is not conserved. 

7. Conclusions 

With the aim of reaching a deeper understanding of the Quasi Stationary States 
(QSS) observed in the HMF model, we have studied in this paper the Vlasov equa- 
tion of a set of uncoupled pendula. 

These studies are relevant for understanding the extrapolation from single par- 
ticle to collective properties in physical systems with unscreened long-range inter- 
actions, like Coulomb or dipolar. They will also lead to a better understanding of 
kinetic equations, like the Vlasov equation, whose mathematical structure appears 
in many different fields, including quantum transport at the nanoscale with the use 
of the Wigner-Poisson system. 

Lynden-Bell's theory applies successfully to the uncoupled pendula model. We 
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have found good predictions for both the magnetization and the marginals (p{p) and 
p{0) of the single particle distribution function in the QSS, although the agreement 
with numerical simulations depends on the chosen initial state. 

The discrepancy that we observe between the theory and the numerical results 
has provided us with a hint on how to extend the theory by including the moments 
of the velocity distribution for the zero field case. This is justified by the presence of 
a further conserved quantity for the uncoupled pendula case: the energy distribution 
p{e) in formula (|2.9p . 

Unfortunately this approach is not straightforwardly applicable to the HMF, 
because the energy distribution is not conserved. However, it has been recently 
realized that the steady state distribution of the model of uncoupled pendula can 
be obtained analytically (de Buyl et al. , 2010) and shows properties very similar 
to those of the HMF model. 
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